RANDOM TIGHT FRAMES 



M. EHLER 



Abstract. We introduce probabilistic frames to study finite frames whose el- 
ements are chosen at random. While finite tight frames generalize orthonormal 
bases by allowing redundancy, independent, uniformly distributed points on 
the sphere approximately form a finite unit norm tight frame (FUNTF). In the 
present paper, we develop probabilistic versions of tight frames and FUNTFs 
to significantly weaken the requirements on the random choice of points to 
obtain an approximate finite tight frame. Namely, points can be chosen from 
any probabilistic tight frame, they do not have to be identically distributed, 
nor have unit norm. We also observe that classes of random matrices used in 
compressed sensing arc induced by probabilistic tight frames. 



1. Introduction 

Frames are basis-like systems that span a vector space but allow for linear de- 
pendency, which can be used to reduce noise, find sparse representations, or obtain 
other desirable features unavailable with orthonormal bases. They have proven use- 
ful in fields like spherical codes, compressed sensing, signal processing, and wavelet 
analysis P EJ [HI [TU1 [III [121 [111 [I1J [III [ISJ [111 [11] . Tight frames even provide a Par- 
seval type formula similar to orthonormal bases. However, characterizations and 
constructions of finite tight frames and finite unit norm tight frames (FUNTFs) 
were needed [6] . A general characterization of all FUNTFs was given by Benedetto 
and Fickus in [2], where they proved that the FUNTFs are exactly the minimizcrs 
of a functional called the frame potential. This was extended to finite tight frames 
in [3U] . Casazza and Fickus have considered the frame potential in the framework 
of fusion frames [5]. To approximate a FUNTF, Goyal, Vetterli, and Thao consid- 
ered in |18| n random points on the sphere. In fact, they showed that independent, 
identically distributed (i.i.d.) points according to the uniform distribution on the 
sphere asymptotically (as n — > oo) become a FUNTF. 

The present paper is concerned with frames in a probabilistic setting and the 
generalization of the results of Goyal, Vetterli, and Thao. Our aim is to allow for a 
more flexible choice of n points while still preserving the asymptotical tight frame 
property. Wc first introduce probabilistic frames and adopt many concepts and 
properties from finite frames to the probabilistic setting. Probabilistic versions of 
frames, tight frames, Parseval frames, and FUNTFs are developed. After observing 
that the uniform distribution on the sphere is a probabilistic unit norm tight frame, 
we extend the results about the random choice of n points on the sphere as follows: 
in comparison to [18] , we are not limited to the uniform distribution and allow for 
any probabilistic tight frame. Moreover, the points do not have to be identically 
distributed nor must they lie on a sphere. This means a significant weakening of 
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the assumptions in |18| and offers much more flexibility. We use this extension to 
observe that Bernoulli, Gaussian, and sub-Gaussian random matrices, which are 
used in compressed sensing, fit into this scheme by choosing their rows according 
to probabilistic tight frames. 

To better understand probabilistic tight frames, wc minimize the frame potential 
as introduced by Benedetto and Fickus within a probabilistic setting. In fact, 
we characterize probabilistic tight frames as minimizcrs of the probabilistic frame 
potential, which also generalizes [50] • Relations to spherical i-designs 0(21] are 
also discussed. 

The outline is as follows: In Section[2l we recall finite frames, the frame potential, 
and the characterization of its minimizers as derived by Benedetto and Fickus. We 
also recall the results of Goyal, Vetterli, and Thao about the random choice of 
n points on the sphere. Section [3] is dedicated to studying probabilistic frames 
that are introduced in Section 13.11 Well-known properties from finite frames are 
adopted to the probabilistic setting, and we define and study probabilistic tight 
frames. We then generalize the results of Goyal, Vetterli, and Thao in Section I3~2l 
In Section |4j we study the probabilistic frame potential. We show in Section 14.11 
that its minimizers are the probabilistic tight frames, and the relations to spherical 
t-designs are addressed in Section 14.21 Conclusions are given in Section [5] 

2. Background 

A collection of points {xi}f =1 C K d is called a finite frame for ~R d if there are 
two constants < A < B such that 

n 

(1) A\\x\\ 2 < ^2\(x, Xl )\ 2 < B\\x\\ 2 , for all x 6 M. d . 

i=l 

The constants A and B are called lower and upper frame bounds, respectively. In 
fact, finite frames are the finite spanning sets [7]: 

Lemma 2.1. The sequence {xi}™ =1 C K d is a finite frame for M. d if and only if it 
spans M. d . 

The frame property can also be expressed by means of operators. Given a col- 
lection of n points in R d , we call 

F : K d — > E", x H- {{x,Xi)) n i=1 

the analysis operator. Its adjoint operator 

n 

F* : M" -> R d , (ci)ti ^ 

i=l 

is called the synthesis operator. If the collection is a finite frame for R d , 

then the frame operator S = F*F is positive, self-adjoint, and invertible [7]. In 
this case, the following reconstruction formula holds, 

n n 

(2) x = ^{S- 1 x l ,x)x l = Y^(xi,x)S- 1 x i , for all x 6 M d , 

3=1 3=1 

and {S' _1 a;i}" =1 , in fact, is a frame too, called the canonical dual frame. 
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Frames, whose lower and upper frame bounds coincide, play a special role, and 
we call a collection of points {:Ei}™ =1 C M. d a finite tight frame for M. d if there is a 
positive constant A such that 

n 

(3) ^||x|| 2 =^2\(x, Xi )\ 2 , for all x e R d . 

i=l 

The constant A is called the tight frame bound. Note that every finite tight frame 
gives rise to the expansion 

1 " 

(4) x — — y^^(x,Xj}xj, for all x eM. d . 

i=l 

In this sense they are a generalization of orthonormal bases. The following lemma 
summarizes the standard characterizations of tight frames, cf. [7J: 

Lemma 2.2. Let {xi}™ =1 be a collection of vectors in M. d , and let A be a positive 
constant. The following points are equivalent: 

(i) {xi}™ =1 is a finite tight frame for R d with frame bound A, 

(ii) F*F = AI d , 

(hi) Equation (U) holds. 

If A — 1 in <|3j> , then we call C R d a finite Parseval frame. If all elements 

of a finite tight frame have unit norm, we call them a finite unit norm tight frame 
(FUNTF) for R d . Note that a FUNTF that is also Parseval must be an orthonormal 
basis [7j. In fact, the frame bounds of a FUNTF are given by: 

Lemma 2.3 ([IS]). If {x J™ =1 C R d is a FUNTF, then the frame bound A equals 
n/d. 

Every finite frame for M. d gives rise to a Parseval frame, cf. [7J: 

Lemma 2.4. If {xi}^ =1 is a finite frame for M. d with frame operator S, then 
{5 _1 / 2 a;i}f =1 is a finite Parseval frame for K d . 

The following identity and inequality for Parseval frames have been derived in 

®- 

Theorem 2.5 (|Tj). Let {xi}f =1 C M. d be a finite Parseval frame for M. d . For every 
subset J C {1, . . . , n} =: Af n and every x £ M. d , we have 

^2\(x,X l )\ 2 - \\^2(x,Xi)Xi\\ 2 = ^ K^J^i)! 2 _ || X] ( x > x i) x i\\ ) 

ie.7 ieJ ieA/WV ieAf n \J 

^2\(x,Xi)\ 2 -\\ (x,Xi)xi\\ 2 > ^\\x\\ 2 . 

Given n points {xi}f =1 on the sphere S^ 1 = {x 6 K d : ||x|| = 1}, the frame 
potential as introduced by Benedetto and Fickus in [5] is 

n n 

(5) FP({x i }? =1 ) = ^^|(x,,^}| 2 . 
For fixed n, they characterized its minimizers: 

Theorem 2.6 ([2j). Let n be fixed and consider the minimization of the frame 
potential among all collections of n points on the sphere S^ 1 . 
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n < d: The minimum of the frame potential is n. The minimizers are exactly the 
orthonormal systems for M. d with n elements. 

2 

n > d: The minimum of the frame potential is . The minimizers are exactly the 
FUNTFs for R d with n elements. 

The overlap n = d in Theorem 12.61 is not a problem since every FUNTF with 
n = d elements is an orthonormal basis. Waldron derived an estimate of the frame 
potential for general points in R d , not necessarily on the sphere: 

Theorem 2.7 ([30]). If {xi}? =1 C R d are not all zero and n > d, then 

E?=i£;uifc.sj)i 2 > i 

(EIUINI 2 ) 2 ~ d ' 

and equality holds if and only if {xi}™ =1 is a finite tight frame for Mr. 

Goyal, Vetterli, and Thao have shown in |18j that independent and uniformly 
distributed points on the sphere converge towards a FUNTF. To properly formulate 
the convergence, let Ai(B, S^ -1 ) denote the collection of probability measures on 
S ,d " 1 with respect to the induced Borel a algebra B. If Z : S"^ 1 -> U C M pX9 
is a random matrix/ vector, distributed according to /i € A4(B, S"^ 1 ), then wc 
simply write Z <G U for notational convenience. The expectation of Z is defined by 
E(Z) := Z(x)dfi(x), where the integral is taken component-wise. Note that 

for a collection of random vectors {Xi}f =1 C S ,d_1 , the frame operator is a random 
matrix. 

Theorem 2.8 ([18]). For any n, let {Xk t n}k=i C S ,d ~ 1 be a collection of n random 
vectors, i.i.d. according to the uniform probability distribution on the sphere. If F n 
denotes the random matrix associated to the analysis operator of {Xk : n}k=i^ then 
the matrix operator ^F*F n converges towards in the mean squared sense, i.e., 
E(\\-^F*F n — 2^d\\jr) 0, where \\ ■ \\jr denotes the Frobenius norm. 

Note that ^F*F n = jl-d would mean that we have a FUNTF, cf. Lemma l2~2l In 
the present paper, we develop a framework that leads to a significant generalization 
of Theorem [2751 

3. Probabilistic Frames 

3.1. Probabilistic Tight Frames. In this section, we shall introduce a probabilis- 
tic analogue of finite frames. Let K be a nonempty subset of M d and let M(B, K) 
denote the collection of probability measures on K with respect to the induced 
Borel a algebra B. 

Definition 3.1. A probability measure [i € A4(B, K) is called a probabilistic frame 
for M. d if there are constants < A < B such that 

A\\x\\ 2 < [ \{x,y)\ 2 df4y) <B\\x\\ 2 , for all x E R d . 

The constants A and B are called lower and upper probabilistic frame bounds, 
respectively. If only the upper inequality holds, then we call fj, a Bessel measure. A 
probabilistic frame /j, for M. d is called a probabilistic unit norm frame if K = S^ 1 . 

It should be mentioned that Definition 13. II is not entirely new, but constitutes a 
shift of perspective: 
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Remark 3.2. In standard continuous frame theory, the measure \i is fixed and 
elements in a Hilbert space form the frame that is indexed by a continuous set. 
Definition 13.61 means a shift of perspective because we identify the index set with 
the elements in the Hilbert space and hold them fixed (to be K). We now allow 
the measure fi to vary, which then encodes the frame. 

If {xi}f =1 is a frame for M. d , then the normalized counting measure —fi Xl ...,x n i s 
a probabilistic frame for M. d with respect to any subset K that contains {xi}f_ v 
Thus, Definition 13.11 extends the concept of finite frames for K d . 

The support of /i G M(B, K) is 

supp(/i) = {x G K : fx(U x ) > 0, for all open subsets U x C K that contain x}, 
and the following is the probabilistic counterpart of Lemma 12.11 

Proposition 3.3. Assume that K C R d is bounded. A probability measure /i G 
A4(B, K) is a probabilistic frame for R d if and only if its support spans M. d . 

Proof. If the support does not span M. d , then there exists an clement x G supp(/i)^ 
that satisfies J K \(x,y)\ 2 dfi(y) = 0. Therefore, fx cannot be a probabilistic frame. 

For the reverse implication, we observe that the Cauchy- Schwartz inequality 
yields 

(6) / \{x,y)\ 2 dn{y) < sup(||y|| 2 )|M| 2 , for all x G R d . 

JK y£K 

Since K is bounded, (i is a Bessel measure and the upper probabilistic frame bound 
B exists. To find a lower probabilistic frame bound, let us define 

A:= M d ( k^^l )= inf i( / \(x,y)\ 2 dfM(y)) . 

Due to the dominated convergence theorem, the mapping x i-> J K \ {x,y)\ 2 dfi{y) is 
continuous and the infimum is in fact a minimum since S^ -1 is compact. Let x be 
in S^ 1 such that 

A= f \(x,y)\ 2 dv(y). 

JK 

Since supp(/x) spans R d , x cannot be in the orthogonal complement of supp(/x), and 
thus there is yo G supp(/z) such that \(x,yo)\ 2 > 0. Therefore, there is e > and 
an open subset U yo c K satisfying y G U Vo and \ (x,y)\ 2 > e, for all y G U ya . Since 
n{Uy ) > 0, we obtain A > efi(U Vo ) > 0, which concludes the proof. □ 

The analysis operator 

F :R d ^ L 2 (K, f i), x^(x,-) Rd 

is bounded with norm less than or equal to sup yg ^(||j/|| 2 ) if and only if ^ holds. 
We call the adjoint operator 

F* : L 2 (K,n) -+ R d , f^f f(x)xdfi(x) 

JK 

the synthesis operator, where the integral is vector valued. If /i G -M(£>, K) is 
a probabilistic frame for M. d with frame operator S = F*F, then S is positive, 
self-adjoint, and invertible. Moreover, for fj, = (i o S, we obtain 

(7) y= I Sz (z,y) dfj(z) = I z (S z , y) dfi(z) , for all y G R d , 

JS- 1 K JS- 1 K 
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which follows from S~ 1 S = SS -1 = Id- In fact, if fj, € Ai(B,K) is a probabilistic 
frame for R d , then // 6 M{S~ 1 B, S _1 A") is a probabilistic frame for R d . Note that 
if /i is the counting measure corresponding to a FUNTF {2^}™ =1 . then // is the 
counting measure associated to the canonical dual frame of {xi}" =1 , and Equation 
(J7J reduces to ([2]). These observations motivate the following definition: 

Definition 3.4. If [i € M(B,K) is a probabilistic frame with frame operator S, 
then /5 = fj, o S € .M(S _1 j8, S^K) is called the probabilistic canonical dual frame 
of /i. 

Remark 3.5. The frame operator Si of a finite frame {xi}™ =1 has a different 
normalization than the frame operator S2 of the associated normalized counting 
measure —fJ- X i,...,x n - I n fact, we have S2 = —Si. 

Next, we generalize finite tight frames: 

Definition 3.6. A probability measure /j, E A4(B,K) is called a probabilistic tight 
frame for R d if there is a positive constant < A such that 

(8) A\\x\\ 2 = [ \{x,y)\ 2 d^(y), for all x E R d . 

We call /i a probabilistic Parseval frame for R d if (JSJ) holds with A = 1. The 
probability measure is called a probabilistic unit norm tight frame for if it is 
a probabilistic tight frame with K = S d_1 . 

The following lemma is the probabilistic version of Lcmma [2.2l and can be derived 
from results in continuous frame theory: 

Lemma 3.7. Let /1 £ Ai(B,K) and let A be a positive constant. The following 
points are equivalent: 

(i) 11 is a probabilistic tight frame with frame bound A, 

(ii) F*F = AI d , 

(hi) x = \ J K (x, y)ydfi(y), for all x G M. d . 

Many properties of finite frames can be carried over. For instance, we can follow 
the lines in [7] to derive a generalization of Lemma 12.41 

Proposition 3.8. If \i 6 Ai(B, K) is a probabilistic frame for R d , then [i o S 1 / 2 S 
M(S~ 1 / 2 B, S _1 / 2 /\ ) is a probabilistic Parseval frame for R d . 

Only the frame operator and associated operators are used in the proof of The- 
orem 12.51 in [T] . Therefore, we can follow those lines and obtain the fundamental 
identity and inequality of probabilistic Parseval frames: 

Proposition 3.9. Let ji G AiB, K) be a probabilistic Parseval frame for M. d . For 
every measurable subset J C K and every x € M. d , we have 

/ \(x,y)\ 2 d^(y) - || / (x,y)ydfi(y)\\ 2 = / | (x, y) \ 2 dfi(y) - || / (x,y)ydn(y) 
J j J j Jk\j jk\j 

{ \{ Xl y)\ 2 d^y)-\\ j {x,y)yd^y)\\ 2 >-\\x\\ 2 . 
Jj Jk\j 4 

If {xi}f =1 C M. d are pah-wise distinct vectors, that form a finite tight frame for 
M. d , then the normalized counting measure — l*i X i,...,x„ is a probabilistic tight frame 
for R d . Lemma l2~3l can also be carried over: 
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Lemma 3.10. If fi E A4(B,K) is a probabilistic tight frame for M. d , then the frame 
bound A equals \ J K \\x\\ 2 diJ,(x). 

Proof. If ei, . . . , ed is the canonical basis for R d , then we have Ad = 2»=i ^-ll e il| 2 - 
The equality (|5|) and finally the Parseval equality for orthonormal bases yield 

Ad = Hl \{e j ,x)\ 2 d l x(x) = I ^ l \(e j ,x)\ a dfi(x) = f \\x\\ 2 dfi(x). D 
i=i Jk Jk i=i Jk 

For fj, G M(B, K), one easily verifies that the frame operator S = F*F is given 

by 

F*F : R d -> R d , F*F(x) = f (x, y)yd^(y). 
If {ei} d is the canonical basis for M. d , then the vector valued integral yields 

yWydfi(y) = J2 / y {i) y u) d^ y )e 3 , 



where y = (y( 1 ),...,yW) T G M. d . If we denote the second moments of by rriij (/z) , 



i.e. 



mij(fi) = / x^x^dn(x), for i,j = 1, 



K 



then wc obtain 



~ dr. d 

F*Fe l= / ^VM2/) = E/ //"// ' Y,'"-.rl lU r 

Jk j=1 Jk . =1 

Thus, the frame operator is the matrix of second moments. As a consequence, 
Lemma |3 . 71 implies the following characterization of probabilistic tight frames: 

Corollary 3.11. A probability measure /.i G -M(£>, K) is a probabilistic tight frame 
for M. d if and only if its second moments satisfy 



(9) ™>i,j(v) = ~A,3 / IMI 2 ^^), for all i,j = l,...,d. 



K 



Remark 3.12. Bourgain raised in [3] the following question: Is there a universal 
constant c > such that for any dimension d and any convex body K in W l with 
voLi(A') = 1, there exists a hyperplane H C K d for which vo\d~\{K n H) > c? The 
positive answer to this question has become known as the hyperplane conjecture. By 
applying results in |23j . we can rephrase this conjecture by means of probabilistic 
tight frames: There is a universal constant C such that for any convex body K , 
on which the uniform probability measure o~k forms a probabilistic tight frame, the 
probabilistic tight frame bound is less than C . Due to Lemma l3.101 the boundedness 
condition is equivalent to J K \\x\\ 2 daK {x) < Cd. The hyperplane conjecture is still 
open, but there are large classes of convex bodies, for instance, gaussian random 
polytopes |21j . for which an affirmative answer has been established. 

Let us further investigate the uniform probability measure: 

Proposition 3.13. The uniform probability measure a r on the sphere of radius 
r > is a probabilistic tight frame. 
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Proof. We aim to verify the conditions in Corollary 13. Ill First, we consider i ^ j: 
we divide the sphere S^ 1 = {x £ R d : \\x\\ = r} into four parts, 

Pi = {x 6 Sf' 1 : < < 1}, 

P 2 = {x£ S?- 1 : < x®, -xCj) < 1}, 

P 3 = G : < -rcW.a^ < 1}, 

P 4 = {a; G S^ 1 : < -xW,- a (j) < 1}. 

Due to symmetry, we obtain 

/ x^x^da r {x) = - j x (l) x^da r (x) = - [ x^x {3) dcr r (x) = [ x^ x U) da r {x). 

J Pi JP 2 JPz JPi 

Therefore, we derive 

[ x^x^do-Jx) =V f x^x^daJx) = 0. 

To tackle i — j, we first observe that 

1 = a.^^ 1 ) = \\ ||x|| 2 *r r (a:) = \ V / A«d£r r (aO. 
r JS^ 1 r i=1 Js^ 1 

Due to symmetry, the term J S d-i r'i'% r (i) does not depend on the choice of 
i and we must therefore have f s <i-i x^x^da r (x) = r 2 /d. According to Corollary 
13.111 a r is a probabilistic tight frame for M. d . □ 

Remark 3.14. The above proof primarily uses the symmetry of the sphere. Thus, 
Proposition 13.131 holds for a much larger class of uniform probability measures on 
symmetric sets K . For instance, it holds for the uniform probability measure on 
B p (r) := {xeR d : \\x\\ lp < r} and dB p (r), for < p < oo. 

Next, we construct continuous nonuniform probability measures on the unit circle 
that form probabilistic unit norm tight frames. Let a g A4(B, S^ 1 ) represent the 
uniform probability measure on the circle: 

Proposition 3.15. If{x t }" =1 C S 1 is a FUNTF and f : R -> K is a function, such 
that, for alii = 1, . . . , n, y h-» f({xi,y)) is measurable and J s± f((xi,y))da(y) = 1, 
then the probability measure 

1 ™ 

(10) f i(x) = -y2f((x l ,x))a(x) 

i=i 

is a probabilistic unit norm tight frame for M 2 . 

Proof. Let = { ( ^(a*) ) = * = 1, ■•-,"}, for < ai ,...,«„< 27r. Since, for 

any /3 G [0, 2n), the collection { ( ) : i = 1, . ■ ■ ,n} is a rotation of {xi}™ =1 , 
it also forms a FUNTF, for all < /3 < 2ir. If we parametrize the circle by [0, 2ir), 
then the mixture in ()10[) can be carried over to [0,27r) and may be written as 

1 - 

- J2f( C o S (p-ai))dp, /3G[0,27r), 
i=i 
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where we have used Xi = ( ^(a'j ) and cos(/3) cos(aj) + sin(/3) sin(aj) = cos(/3 — a,). 
This yields, for any x G R 2 , 

/ Ky,x)|Xa;)= / \(x, (£<g )>| 2 - £ /(co S (/3 - 

= / K*.(s:g;:S)>r/(ooB(a ( +/9-a ( ))^ 

i=l 1/0 

=i/ /(cos(/3))^i<x,(:3: : :S))r^ 

n J 2 2 

Next, we give an example of Proposition 13.151 that is used in [13] to model the 
patterns found in granular rod experiments: 

Example 3.16. Let xq G S 1 and n > 0. For the density fi(t) = -^■exp(nt), we 
call 

Mi(^) = h{{ x o,x))a{x) 
the von Mises measure, which reflects the normal distribution on the circle, see 
[22] . The constant c normalizes [i such that /^(S" 1 ) = 1. The Watson measure 
fi G M(B, S 1 ) is given by 

H2(x) = f 2 {(x ,x} 2 )o-(x), 

where f2(t) = ^exp(Att 2 ), and c 2 is a normalizing constant, cf. [35]. For k > 0, 
the density of the Watson measure tends to concentrate around ±xq, whereas for 
k < 0, the density concentrates around the great circle orthogonal to xq. And as 
\k\ increases, the density peaks tighten. 

Watson and von Mises measures are widely used in directional statistics. Both 
densities /1 and / 2 satisfy the assumptions of Proposition ^. 151 Therefore, FUNTF 
mixtures of von Mises and Watson measures according to (fit)]) form probabilistic 
unit norm tight frames for R 2 . 

The proof of Proposition 13.151 implicitly relies on the commutativity of the ro- 
tation group in R 2 . The special group in R d , for d > 2, is not abelian, and we 
need slightly stronger assumptions. Let G be a finite subgroup of the orthogonal 
matrices 0(R d ). The G-orbit of x G R rf is the collection {gx : g G G}. The finite 
subgroup G is called irreducible if the G-orbit of any nonzero x G R d spans R d . If 
G C 0(R d ) is an irreducible finite group, then the G-orbit of any nonzero x G R d 
is a finite tight frame for R d , cf. [25]. The latter can be used to verify that the 
n-th roots of unity, vertices of the platonic solids, and vertices of the truncated 
icosahedron are finite tight frames, cf. [28]. This construction can also be applied 
to probability distributions: 

Proposition 3.17. Let G be a finite irreducible subgroup ofO(M. d ) and xq G S 
If [i G M(B, iS"^ -1 ), then the probability measure 

AO) = 7777 ^9*x) 
is a probabilistic unit norm tight frame for R d . 
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Proof. Since {gx : g E G} is a finite tight frame, we obtain 

/ \(y,x)\ 2 dfi{x) = V / (i/,x)| 2 d/i( 5 *:z;) 



-y 



S d-i 

d-l 



(y,gx)\ d/j,(x) 

f 2\\vfM*) = \\\v\\ 2 - D 



3.2. Random Tight Frames for K d . The following theorem is the main result of 
the present paper. Compared to Theorem l2.8[ we can replace the uniform distribu- 
tion with any probabilistic tight frame and the points do not have to be identically 
distributed. To properly formulate the result, let us recall some notation that we al- 
ready used in ThcorcmEl We define E{Z) := J K Z(x)dfJ,(x), where Z : K -» W xq 
is a random matrix/vector that is distributed according to fi E M.(B, K). For no- 
tational convenience, we write Z E K if Z maps into K: 

Theorem 3.18. Let {Xk}^ =1 C K be a collection of random vectors, independently 
distributed according to probabilistic tight frames {^k}k=i C M(B,K), respectively, 
whose 4-th moments are finite, i.e., := J„ \\y\\ A dpik{y) < oo. If F denotes the 
random matrix associated to the analysis operator of {Xk}^ = i, then we have 

(ID E^F-F-fafo^N-Z), 

where L := ± ELi L k , l:=\ ELi L\, L k := J K \\y\\H^{y), and N = i ^Li N »- 

Note that Tyler used FUNTFs to derive M-estimators of multivariate scatter in 
[2Ql[26j 271. Those results are related to the estimation of the population covariance 
matrix from the sample covariance, and the latter is closely related to Theorem l3.18l 

Proof. We observe that the (i, j)-th entry of the random matrix operator F*F is 
given by 



{F*F) itj = Y,X^X«\ 

k=l 

where Xk = {xjp , . . . ,xjf^) T . First, we fix and derive 

k.l k=l 

1 n 1 



ry^A S J - <V S J K K I I 

k=l k£l 



k=l 
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Let us denote M k (i,j) := j K \y {i) \ 2 \y U) \ 2 d^ k {y) and M = ± YZ=\ M k- Since the 
random vectors arc independent and the measures {/^fc}^ =1 satisfy we obtain 

fc=i fe^; 



1 " 1 " 1 L? 

k=l k=l 



1 v— ^ ,. L* L L A 



k=l 



l " z 



'■./ 



fc=l 



1 



(12) = -(M id - -^5 itj ). 

1 /2 

The Frobenius norm \\A\\j- of a matrix A = equals (X^j a ?i) ■ Since 

-F* F — IjTd is a d x d matrix, we obtain 

k=l JK 

If the A& in Theorem 13.181 are bounded by a universal constant, then (fTTj) es- 
sentially decays as — . The smaller ./V the faster tends (j 1 1 [) to zero. In other words, 
the 4-th moments specify the exact decay. 

Let us present few examples that lead to asymptotic tight frames: 

Example 3.19. We have already pointed out in Remark |3. 141 that uniform proba- 
bility measures on £ p -balls and £ p -spheres, for < p < oo, form probabilistic tight 
frames. According to Theorem 13.181 i.i.d. random points according to the latter 
distributions approximate a tight frame. 

Remark 3.20. Vcrshynin has derived a result about the approximation of covari- 
ance matrices that is similar to Theorem 13.181 His statement is about convergence 
with high probability in the operator norm. The approximation error is then es- 
timated by a constant times (^) 1 ^ 2-2 ^ 9 , where all {^tfc}^ =1 must have finite q-th 
moments and q > 4, cf. Theorem 6.1 in [29] . For sub-Gaussian distributions, i.e., 
for /I such that, for some s > 0, 

fi(\{X,x)\ >t)< 2e~£, for t > and x g 

where X is distributed according to fi, Vcrshynin can estimate the approximation 
error in the operator norm by a constant times (— ) 1 ^ 2 , cf. Proposition 2.1 in [29] . 
Note that the latter matches our decay rates for the mean squared error (we squared 
the Frobenius norm). Nevertheless, our results address more general distributions 
since Theorem 13.181 only requires that the 4-th moments exist. We do not have any 
assumption on higher moments, and we do not require that the distributions are 
sub-Gaussian. 



For probabilistic unit norm tight frames, Theorem 13 . 1 81 simplifies as follows: 



12 



M. EHLER 



Corollary 3.21. Let {Xk}k=i C S^ 1 be a collection of random vectors, inde- 
pendently distributed according to probabilistic unit norm tight frames {^k}k=i C 
A4(B, S^ 1 ), respectively. If F denotes the random matrix associated to the analysis 
operator of {Xk}k =1 , then 

(13) sdll^-^) = 

Randomness is used in compressed sensing to design suitable measurements ma- 
trices. Each row of such random matrices is a random vector whose covariancc 
must usually be close to the identity matrix. The construction of random vectors 
in compressed sensing is commonly based on Bernoulli, Gaussian, and sub-Gaussian 
distributions. We shall explain that these random vectors are induced by proba- 
bilistic tight frames, and in fact, we can apply Theorem 13.181 

Example 3.22. Let {Xk}k =1 be a collection of d-dimensional random vectors such 
that each vector's entries are i.i.d according to a probability measure with zero mean 
and finite 4-th moments. This implies that each Xk is distributed with respect to 
a probabilistic tight frame whose 4-th moments exist. Thus, the assumptions in 
Theorem l3.18l are satisfied, and we can compute (fTT|) for some specific distributions 
that are related to compressed sensing: 

• If the entries of X^, k = 1, . . . , n, are i.i.d. according to a Bernoulli distri- 
bution that takes the values ±-4g with probability |, then Xk is distributed 
according to a normalized counting measure supported on the vertices of 
the d-dimensional hypercube. Thus, Xk is distributed according to a prob- 
abilistic unit norm tight frame for M. d , cf. Remark l3.141 and Corollarv l3.21l 
can be applied. 

• If the entries of Xk, k = 1, . . . , n, are i.i.d. according to a Gaussian distri- 
bution with mean and variance ^ , then Xk is distributed according to a 

multivariate Gaussian probability measure fi € M.(B, M d ) whose covariance 
matrix is h^-d, and /i forms a probabilistic tight frame for R d . Since the 
moments of a multivariate Gaussian random vector are well-known, we can 
explicitly compute iV = l + |,_L=l, and L = 1 in Theorem 13.181 Thus, 
the right-hand side of (fTTj) equals —(1 + 4). 

• If the entries of Xk, k = 1, . . . , n, are i.i.d. with respect to a sub-Gaussian 
probability measure with mean, then Xk is distributed according to a 
probabilistic tight frame for M. d that has finite moments, and Theorem 13. 181 
can be applied. 

Remark 3.23. When compressed sensing is applied to MRI, the rows of the dis- 
crete Fourier matrix W = k=0 i where u> = e~s~ and i 2 = —1, are usually 
subsampled to reduce acquisition time. A uniform subsampling of the discrete 
Fourier matrix is induced by a (complex) probabilistic tight frame: The entire ma- 
chinery of probabilistic frames for M. d developed in Section 13.11 can be extended to 
probabilistic frames for C d in a straight-forward manner. Synthesis, analysis, and 
frame operator can be analogously defined, and a probability measure fj, on K C C d 
is then a probabilistic tight frame for C d if and only if its "second moments" satisfy 

/ z®jfidn(z) = -5^ [ \\z\\ 2 dfi(z). 

JK « JK 
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Let {Zk}'k =1 be a collection of random vectors that are i.i.d. according to a nor- 
malized counting measure \i supported on the row vectors of the discrete Fourier 
matrix. Since W is unitary and the absolute value of each entry is the lat- 
ter measure is a probabilistic tight frame for C d , and its "4-th moments" satisfy 
J K \z^'\ 2 \z^\ 2 dfx(z) = jp. Corollary 13.211 can also be extended to probabilistic 
tight frames for C d . 

Wc conclude this section by rephrasing Theorem 13. 181 in terms of general proba- 
bility distributions on K C K that are not necessarily tight frames. For a matrix 
U = (uy) £ R dxd , we denote ||£/||i := ^ \u id \: 

Theorem 3.24. Let {Xk}^ =1 C K be a collection of random vectors that are 
independently distributed according to probability measures {nk}k=i C Ai(B,K), 
respectively, whose 4-th moments are finite, i.e., Nk := J K WyW^dfikiu) < oo. Let 
{Sk}k=i be the frame operators of {[Ak}k=i> respectively. If F denotes the random 
matrix associated to the analysis operator of {Xk}2 = n then we have 

E{\\±F>F-Sfr) = ±{N-\&, 
n n ar 

where S = \ YZ=\ S k, Si,j = \ £Li((Sfckj) 2 ; and N = ± J2k=i N k- 

For instance, Theorem 13.241 applies to random vectors that have a multivariate 
sub-Gaussian distribution and whose entries are not necessarily independent. The 
proof can be derived by following the lines of the proof of Theorem 13.181 while 
replacing ^j- with Sk- 



4. The Probabilistic Frame Potential 

4.1. Minimizing the Probabilistic Frame Potential. The minimizers of the 
frame potential are the configurations of n points on the sphere that form a FUNTF. 
What happens if we have to distribute a continuous mass on the sphere S^ -1 or, 
more general, on K C M d ? 

Definition 4.1. For K and \i e M(B, K), we call 

(14) PFP(u) = kL\( x 'V)\ 2d ^W{y) 

(j^]|zf^(a;)) 2 

the probabilistic frame potential of /i. 

We easily observe that supp(/i) ^ {0} if and only if J K \\x\\ 2 d/j,(x) ^ 0. There- 
fore, PFP(/x) in (|14p is well-defined. We aim to characterize the minimizers of the 
probabilistic frame potential for fixed K. In fact, these minimizers are the prob- 
abilistic tight frames provided that the latter exist for the particular choice of K. 
The following theorem generalizes Theorem 12.71 

Theorem 4.2. J/0 £ K and \i E M(B,K), then 

(15) PFP(/i) > - d , 



and equality holds if and only if [i is a probabilistic tight frame for 



p el 
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Proof. Let mi, j (/i) denote the second moments of /i, i.e., mi j (/i) = J K x^ x^' dfj,(x) . 
We obtain 

~ d~ d 

(16) / \\xfd l i{x)=Y j \ xM x Vd f i(x) = Y / m i , i (Li). 

Jk i=i Jk i=i 

The probabilistic frame potential can be written as 

pFp(/i) = 4 gti gti ^^gW^W 

Ei=i m i,i(/") 
= Sf=iEj=i"tj,jM 
EtiWi,iM 

The Holder inequality implies 

(it) t, m M < (E <m) 1/2 (Ei) 1/2 < (EWw) 1 ^. 

2=1 2=1 2=1 2=1 j — 1 

which yields (p~5|) . 

Next, assume that the latter inequalities (|17l) . in fact, arc equalities. This re- 
quires TOij (/i) = 0, for all i ^ j, and the Holder inequality was actually an equality. 
The Holder inequality becomes an equality if and only if the occurring sequences 
are linearly dependent. Thus, (mj i j(/x))^_ 1 must be a multiple of the constant se- 
quence. Due to ([IS]), we obtain m^(/i) = \ \ K \ x \?d[i(x), for all i = 1, . . . , d, and 
hence \x is a probabilistic tight frame, cf. Corollary 13. Ill 

Conversely, if \i is a probabilistic tight frame, then mi t j(fi) = &i,jh J K \\x\\ 2 dfi(x) 
due to Corollary 13. Ill Thus, we have equality in (|T7|) and hence in (fT5"|). □ 

According to Proposition 13. 131 probabilistic tight frames exist for K = S . If 
K = R. d \ {0}, then the normalized counting measure of any finite tight frame is a 
probabilistic tight frame. Hence, Theorem 14.21 leads to the following generalization 
of Theorem El and Theorem O 

Corollary 4.3. If K = then the minimizers of the probabilistic frame po- 

tential are exactly the probabilistic unit norm tight frames for M. d . If K = M. d \ {0}, 
then the minimizers of the probabilistic frame potential are exactly the probabilistic 
tight frames for M. d . 



Let us explore the relations between Corollary 14.31 and the discrete frame poten- 
tial in Theorem [221 For fixed d and K = S^ 1 , every FUNTF induces a minimizcr 
of the probabilistic frame potential: 

Example 4.4. If {a; l }™ =1 C S^ 1 is a FUNTF, then FP({x<}? =1 ) = ^ ac- 
cording to Theorem 12.61 Thus, the discrete point measure — fJ, Xl ,...,x n satisfies 
PFP(i/i a;ii ... lXn ) = hi an d therefore is a minimizer of the probabilistic frame po- 
tential for K = S d -\ 

Contrary to Theorem 12.61 orthonormal systems that are not a basis, do not 
induce a minimizcr: 

Example 4.5. Let {xi}™ =1 C be an orthonormal system with n < d. Due to 
TheoremEU wc have FP({ Xi }f =1 ) = n. For K = S"*" 1 , this implies PFP^/i^,...,^) 
^. Since n < d, we deduce PFP(±[j, Xlt ... tXn ) = ± > I. 
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4.2. Relations to Spherical f-designs. Let a denote the uniform probability 
measure on S d ~ l . A spherical t-design is a finite subset {xi}™ =1 C S^ 1 , such that, 

1 ™ f 
— y h(xi) = / h(x)da(x), 



n ^— ' 

i=l 



S d-i 



for all homogeneous polynomials h of total degree less than or equal to t in d 
variables, cf. [9]. We call a probability measure ii £ M{B 1 S d ^ 1 ) a probabilistic 
spherical t-design if 



(18) / h{x)dLi{x) = / h{x)da{x), 

for all homogeneous polynomials h with total degree less than or equal to t. 
Theorem 4.6. If (J- £ M.(B,S d ^ 1 ), then the following are equivalent: 



(i) fi is a probabilistic spherical 2- design. 

(ii) fi minimizes 



(19) 



Jg rf -i /gd-i |(s,y)| 2 d/x(z)rf/x(?/) 

isd-i Jsd-1 ||a: - y\\ 2 dLi{x)dLi{y) 
among all probability measures Ai(B, S^ 1 ). 



(iii) \i satisfies 

(20) / xd[i(x) = 

(21) / x®xWdfi(x) = \d itj . 

Jsd-i d 

In particular, if li is a probabilistic unit norm tight frame, then f(A) := ^(ii(A) + 
Li[—A)), for A S B, defines a probabilistic spherical 2-design. 

Proof. To show that (i) and (iii) are equivalent, we observe that the uniform prob- 
ability measure a is a probabilistic unit norm tight frame, cf. Proposition 13.131 It 
hence satisfies (|2"Tj) according to Corollary 13. Ill Due to its symmetry, a also satis- 
fies (|2T)|) . Thus according to (fT5|) . the probabilistic spherical 2-designs are exactly 
those probability measures li <E M(B, S^ 1 ) that satisfy ([201) and (|2Tj) . 

To address the equivalence between (ii) and (iii), we will observe that the mini- 
mization (|19[) splits into minimizing its numerator and maximizing its denominator. 
Due to Corollary 13.111 and Corollary 14.31 the numerator is minimized if and only if 
li satisfies (|2"Tj) . Let us rewrite the denominator as follows: 

||z - y\\ 2 dLi{x)dLi(y) = [ f J2 xil)xil) + y (l) y il) ~ 2x (l) y {l) dLi(x)dLi(y) 



gd-i Js<i-i 



[ [ 2dLi(x)dLi(y) ~ 2Y" [ [ x^y^dLi(x)dLi(y) 
J S d-iJ S d-i T~\ Jsd ^ J s- 1 - 1 

2-2±(J sd ^d, { x)y. 



It is hence maximized if and only if xdfx(x) = 0. Thus, (iii) implies (ii). For 
the reverse implication, we need to verify that there is a probability measure that 
minimizes the numerator and maximizes the denominator of (|19p at the same time. 
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We first recall that probabilistic unit norm tight frames exist, cf. Proposition 13. 131 
If fj. is such a probabilistic unit norm tight frame, then v as defined in Theorem 14.61 
satisfies (f^Uj) . and v also satisfies (|2ip since its second moments coincide with those 
of /i. Hence, (ii) implies (iii), and we can conclude the proof. □ 

Remark 4.7. We have shown in the proof of Theorem 14.61 that the maximizers of 
fgd-i fsd-i \\ x ~ v\\ ^( x )dfi(y) are exactly the zero mean probability measures on 
the sphere. The latter result is already implicitly contained in a work by Bjocrck 
[3J, in which he considers the integrals over the unit ball and then shows that the 
mass of the maximizer must completely be contained in the unit sphere. 

5. Conclusions 

First, we introduced probabilistic frames and verified that many properties from 
finite frames can be adopted. Secondly, we used probabilistic tight frames to sig- 
nificantly improve a result by Goyal, Vetterli, and Thao in |18j about the random 
choice of points on the sphere. We still approximate a tight frame while allow- 
ing for a much wider class of probability measures, namely any probabilistic tight 
frame. The requirement of identical distributions is also removed. We also verified 
that many random matrices, which are used in compressed sensing, are induced 
by probabilistic tight frames. Thirdly, we extended results about the frame poten- 
tial as introduced by Benedetto and Fickus in [2|. In fact, we demonstrated that 
probabilistic tight frames are the minimizers of the probabilistic frame potential. 
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